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, , Abstract 
H , 

, ^ . A small-world cellular automaton network has been formulated to simu- 

late the long-range interactions of complex networks using unconventional 
computing methods in this paper. Conventional cellular automata use lo- 
' cal updating rules. The new type of cellular automata networks uses local 

rules with a fraction of long-range shortcuts derived from the properties 
^ of small- world networks. Simulations show that the self-organized criti- 

w ! cality emerges naturally in the system for a given probability of shortcuts 

O ' and transition occurs as the probability increases to some critical value 

pH I indicating the small-world behaviour of the complex automata networks. 

Pattern formation of cellular automata networks and the comparison with 
equation-based reaction-diffusion systems are also discussed. 

Keywords: automata networks, cellular automata, nonlocal PDE, small-world net- 
^ ' works, self-organized criticality. 
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1 Introduction 



- T— I ■ 

^ ' Theory and computation about complex networks such as the bacterial colonies, interacting 



ecological species, and the spreading of computer virus over the Internet are becoming very 
promising and they may have important applications in a wide range of areas. The proper 
modelling of these networks is a challenging task and the studies in this area are still at very 
early stage. However, various techniques and applications have been investigated, especially 
in the area of computational logic, the Internet network, and application of bio-inspired 
algorithms [1-7]. Since the pioneer work of Watts and Strogatz on small- world networks, 
a lot of interesting studies on the theory and application of small-world networks [7-9,12- 
18] have been initiated. More recently, the automata networks have been developed by 
Tomassini and his colleagues [14^ I15j to study the automata network in noise environment. 
Their study shows that small-world automata networks are less affected by random noise. 
The properties of complex networks such as population interactions, Internet servers, forest 
fires, ecological species and financial transactions are mainly determined by the way of 
connections between the vertices or occupied sites. 
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Network modelling and formulations are essentially discrete in the sense that they deal 
with discrete interactions among discrete nodes of networks because almost all the formu- 
lations are in terms of the degrees of clustering, connectivity, average nodal distance and 
other countable degrees of freedom. Therefore, they do not work well for interactions over 
continuous networks and media. In the later case, modelling and computations are usually 
carried out in terms partial differential equations (PDEs), however, almost all PDEs (ex- 
cept those with integral boundary conditions) are local equations because the derivatives 
and the dependent variable are all evaluated at concurrent locations. For example, the 3-D 
reaction-diffusion equation 

ut = DV'^u + r{u-x,y,z,t), (1) 

describes the variation of u{x, y, z, t) such as temperature and concentration with spatial 
coordinates (x, y, z) and time t. While the diffusion coefficient D can be constant, but the 
reaction rate r may depends on u and location (x, y, z) as well as time t. This equation is 
local because n, ut, r and V^u are all evaluated at the same point (x, y, z) at any given time 
t. Now if we introduce some long-distance shortcuts (e.g., a computer virus can spread from 
one computer to another computer over a long-distance, not necessary local computers), 
then the reaction rate can have a nonlocal influence in a similar manner. We can now 
modify the above equation as 

ut = DV'^u + q(u{x,y,z,t),u{x^,y^,Z:,,t);x,y,z,tj, (2) 

where q depends on the local point {x,y,z) and another point (x*,y*,2;*) far away. Ob- 
viously, q can be any function form. As a simple example in the 1-D case: ut = Duxx + 
ii(x, t)*[l — u{x, t)] + j3u{x — s,t), where s is simply a shift and /3 G [0, 1] is a constant. This 
equation is nonlocal since the reaction rate depends the values of u at both x and x — s 
at t. This simple extension makes it difficult to find analytical solutions. Even numerical 
solutions are not easy to find because the standard numerical methods do not necessarily 
converge due to the extra nonlocal term. This paper will investigate this aspect in detail 
using unconventional solution methods such as small-world cellular automata networks. 

The present work aims to develop a new type of small-world cellular automata by com- 
bining local updating rules with a probability of long-range shortcuts to simulate the inter- 
actions and behaviour of a complex system. By using a small fraction of sparse long-range 
shortcut interactions together with the local interactions, we can simulate the evolution of 
complex networks. Self-organized criticality will be tested based on the results from the 
cellular automata. The important implications in the modelling and applications will also 
be discussed. 

2 Small- World Networks 

Small-world networks are a special class of networks with a high degree of local clustering 
as well as a small average distance, and this small-world phenomenon can be achieved by 
adding randomly only a small fraction of the long-range connections, and some common 
networks such as power grids, financial networks and neural networks behave like small- 
world networks |10^ lllj . The application of small- world networks into the modelling of 
infection occurring locally and at a distance was first carried out by Boots and Sasaki [7] 
with some interesting results. The dynamic features such as spreading and response of an 
influence over a network have also been investigated in recent studies [11] by using shortest 
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paths in system with sparse long-range connections in the frame work of small- world models. 
The influence propagates from the infected site to all uninfected sites connected to it via a 
link at each time step, whenever a long-range connection or shortcut is met; the influence 
is newly activated at the other end of the shortcut so as to simulate long-range sparkling 
effect. These phenomena have successfully been studied by Newman and Watts model [12] 
and Moukarzel [TO]. Their models are linear in the sense that the governing equation is 
linear and the response is immediate as there is no time delay in their models [20]. More 
recently, one of the most interesting studies has been carried out by De Arcaneglis and 
Herrmann [8] using the classic height model on a lattice, which implied the self-organized 
criticality in the small-world system concerned. 

On the other hand, cellular automata have been used to simulate many processes such 
as lattice gas, fluid flow, reaction-diffusion and complex systems [181 [T9 l [20 l [21 } I22j in terms 
of interaction rules rather than the conventional partial differential equations. Compared 
to the equation-based models, simulations in term of cellular automata are more stable due 
to their finite states and local interacting rules [18|. In fact, in most cases, the PDE models 
are equivalent to rule-based cellular automata if the local rules can be derived from the 
corresponding PDE models [19\ [9], and thus both PDE models and CA rules can simulate 
the same process [22]. However, we will show that cellular automata networks are a better 
approach for solving nonlocal equation-based models. 

The rest of the present paper will focus on: 1) to formulate a cellular automaton net- 
work on a 2-D lattice grid with sparse long-range shortcuts; 2) to simulate the transition 
and complexity concerning small-world nonlocal interactions; 3) to test the self-organized 
criticality of the constructed network systems; 4) to find the characteristics of any possible 
transition. 

3 Cellular Automata Networks 

Earlier studies on cellular automata use local rules updating the state of each cell and the 
influence is local. That is to say, the state at the next time step is determined by the states 
of the present cell concerned and those of its immediate surrounding neighbour cells. Even 
the simple rules can produce complex patterns [19]. The rule and its locality determine 
the characteristics of the cellular automata. In fact, we do not have to restrict that the 
rules must be local, and in general the influence can be either local or nonlocal. Thus, we 
can assume the rules of cellular automata can be either local or nonlocal or even global. 
The state of a cell can be determined by m cells consisting of immediate neighbour 
cells and mo = m — rrii other cells at longer distance. In the case of local rules only, 
m = rrii and ttIq = 0. If ttIq 7^ 0, then the rules are nonlocal. If m is the same order of the 
total cells N X N of the cellular automaton, then rules are global. Nonlocal interactions 
rule for lattice-gas system was first developed by Appert and Zaleski in the discussion of 
a new momentum-conserving lattice-gas model allowing the particles exchange momentum 
between distant sites [2j. Some properties of local and nonlocal site exchange deterministic 
cellular automata were investigated by researchers [15^ [5] . As the nonlocal rules are different 
from the local rules, it is naturally expected that the nonlocal rules may lead to different 
behavior from conventional local rule-based cellular automata. Furthermore, self-organized 
criticality has been found in many systems in nature pioneered by Bak and his colleagues 
[31 Uj. One can expect that there may be cases when self-organized criticality, cellular 
automata, and small-world phenomena can occur at the same time. More specifically, if a 
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finite-state cellular automaton with a small-fraction of long-range shortcuts is formulated, 
a natural question is: Do the self-organized criticality exist in the small-world cellular 
automaton? Is there any transition in the system? 

3.1 Local Cellular Automata 

A cellular automaton is a finite-state machine defined on a regular lattice in d-dimensional 
case, and the state of a cell is determined by the current state of the cell and the states of 
its neighbour cells [18\ I19j. For simplicity, we use 2-D in our discussions. A state of a 
cell at time step n + 1 can be written in terms of the previous states 

r 

E i,J = l,2,...,N (3) 

k,l=—r 

where summation is over the 4r(r -|- 1) Moore neighbourhood cells. In the d-dimensional 
case, there are (2r -|- 1)'^ — 1 Moore neighbourhood cells. N is the size of the 2-D automaton, 
and Ck.i are the coefficients. For the simplest and well-known 2-D Conway's game of life 
Ck^i = 1 for 8 neighbour cells (r = 1). Now let us introduce some nonlocal influence from 
some sparse long-range cells (see Fig. 1) by combining small- world long-range shortcuts 
and conventional cellular automata to form a new type of cellular automata networks. 

3.2 Small- World Automata Networks 

For simplicity, we define a small-world cellular automaton network as a local cellular au- 
tomaton with an additional fraction or probability p of sparse long-range nonlocal shortcuts 
(see Fig. 1). For rrii = + 1 immediate Neumann neighbours and ruo = 2ro nonlocal 
cells, the updating rule for a cell becomes 

k,l=-rm s,q=-ro 

where 6{p) is a control parameter that can turn the long-range cells on (6 = 1) or off {6 = 0) 
depending on the probability p. 

The probability p is the fractions of long-range shortcuts in the total of every possible 
combinations. For N x N cells, there are N'^{N'^ — 1) possible connections. The simplest 
form of 5 can be written as 6{p) = pH{p — po) where H is a Heaviside function, po is a 
critical probability, and po can be taken as to be zero in most simulations in this paper. The 
updating rules are additive and thus form a subclass of special rules. We can extend the 
above updating rules to a generalized form, but we are only interested in additive rules here 
because they may have interesting properties and can easily be transformed to differential 
equations. In addition, the neighourhood can be either extended Moore neighourhood or 
Neumann neighbourhood. For Moore neighbourhood, rrii = 4rm(7'm + 1) and ttIq = 4ro. 
Our numerical experiments seem to indicate that Moore neighbourhood is more sensitive 
for avalanche and Neumann neighbourhood is more stable for pattern formation. A simple 
case for a small- world cellular automaton in 2-D case is = 1 and tq = 5 (or any > r^) 
so that it has 5 immediate Neumann neighbour cells and 2 shortcuts. 

The distance between the nonlocal cells to cell can be defined as 

S = ^sj + s]. (5) 
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Figure 1: A cellular automaton network with a probability p of long-range shortcuts 



The nonlocality requires 

min(|si|, \sj\) > r^. (6) 

The nonlocal influence can also be introduced in other ways. Alternatively, we can use the 
conventional local rule-based cellular automaton and adding the long-distance shortcuts 
between some cells in a random manner. The probability p of the long-range shortcuts in 
all the possible connections is usually very small. Under certain conditions, these two for- 
mulations are equivalent. More generally, a finite-state cellular automaton with a transition 
rule G = [gij] = 1,2,..., N) from one state <I>" = [cpfj] = 1,2,...,N) at time level 
n to a new state <I>"+^ = [0^^"'^] = 1, 2, N) at time level n + 1 can be written as 

G':ci>«^$"+1, 5,^. :</,«.^^«+i, (7) 

where gij takes the same form as equation Q for small-world cellular automata. 

The state of each cell can be taken to be discrete or continuous. From simplicity, we 
use n^j-valued discrete system and for most of the simulations in the rest of the paper, we 
use fly = 2 (thus, each cell can only be or 1) for self-criticality testing, and = 1024 
for pattern formation. Other numbers of states can be used to meet the need of higher 
accuracies. 

4 Simulations and Results 

By using the small-world cellular automaton formulated in the previous section, a large 
number of computer simulations have been carried out in order to find the statistic char- 
acteristics of the complex patterns and behaviour arising from cellular automata networks 
with different probabilities p of long-range shortcuts. Numerical simulations are carried out 
on an N xN lattice in 2-D setting, and usually, > 40, or up to 5000. Different simulations 
with different lattice size are compared to ensure the simulated results are independent of 
the lattice size and time steps. In the rest of the paper, we present some results concerning 
the features of transition and self-organized criticality of small-world cellular automata. 

4.1 Self-organized criticality 

For a lattice size of A^ = 2000 x 2000 with a fixed p, a single cell is randomly selected and 
perturbed by fiipping its state in order to simulate an event of avalanche in 2-D automata 




size (s) 



Figure 2: Avalanche size distribution for a small-world cellular automaton. 



networks with the standard Moore neighbourhood and Game-of-life updating rules, but a 
probability p is used to add long-range shortcuts to the cellular automaton. A shortcut 
forces the two connecting cells having the same state. Figure 2 shows the avalanche size 
distribution for two different values of p = 0.05 and p = 0.2, respectively. The avalanche 
size is defined as the number of cells affected by any single flipping perturbation. 

In the double logarithmic plot, the data follows two straight lines. It is clearly seen 
that there exists a power law in the distribution, and the gradient of the straight line is 
the exponent of the power-law distribution. A least-square fitting of iV oc s"'*', leads to the 
exponents of 7 = 1.06±0.04 for p = 0.05 and 7 = 1.40±0.05 for p = 0.2. Although a power- 
law distribution does not necessarily mean the self-organized criticality. Self-organized 
criticality has been observed in other systems [1-4,26]. The pattern formed in the system is 
quasi-stable and a little perturbation to the equilibrium state usually causes avalanche-like 
readjustment in the system imply the self-organized criticality in the evolution of complex 
patterns of the cellular automaton. This is the first time of its kind by using computer 
simulations to demonstrate the feature of self-organized criticality on a cellular automaton 
network. We can also see in Figure 2 that different probabilities p will lead to different 
values of exponents. The higher the probability, the steeper the slope. 

4.2 Transition of small-world systems 

For a fixed grid of 2000 x 2000 cells, we can vary the probability p to see what can happen. 
For a single event of flipping state, the fraction of population affected is plotted versus p 
in a semi-logarithmic plot as shown in Figure 3 where the fraction of population is deflned 
as the number (Na) of cells affected among the whole population iV^, that is Na/N'^. The 
sharp increase of the fraction versus the probability p indicates a transition in the properties 
of cellular automata networks. For a very small probability p < 0.004, the influence of the 
event mainly behaves in a similar way as the conventional local cellular automata. As 
the probability increases, a transition occurs at about p = 0.01. For p > 0.05, any event 
will affect the whole population. This feature of transition is consistent with the typical 
small- world networks [121 [21] . 

Comparing with the local rule-based cellular automata, the transition in small-world 
cellular automata is an interesting feature. Without such shortcuts, there was no transition 
observed in the simulations. However, self-organized criticality was still observed in finite- 
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Figure 3: Transition of influence with different probabilities p of long-range shortcuts. 

state cellular automata \L, |21j without transition. In the present case, both self-organized 
criticality and transition emerge naturally. Thus, the transition in cellular automata net- 
works suggests that this transition may be the result of nonlocal interactions by long-range 
shortcuts. 

This feature of transition may have important implications when applied to the mod- 
elling of real- world phenomena such as the Internet and social networks. For a system with 
few or no long-range interactions, there is no noticeable change in its behavior in transition. 
However, as the long-range shortcuts or interacting components increase a little bit more, 
say io p = 0.01, then a transition may occur and thus any event can affect a large fraction 
of the whole population. For example, to increase the speed of finding information on the 
Internet, a small fraction of long-range shortcuts in terms of website portals and search 
engine (e.g., Google) and high-capacity /bandwidth connections could significantly increase 
the performance of the system concerned. In addition, the self-organized criticality can also 
imply some interesting properties of the Internet and other small- world networks, and these 
could serve as some topics for further research. 

4.3 Nonlocal Partial Differential Equations 

The evolution of a system can usually be described by two major ways: rule-based systems 
and equation-based systems. The rule-based systems are typically discrete and use local 
rules such as cellular automata or finite difference system. As discussed by many researchers 
|181l22j. the finite difference systems are equivalent to cellular automata if the updating rules 
for the cellular automata are derived directly from their equation-based counterpart. On 
the other hand, the equation-based systems are typically continuous and they are often 
written as partial differential equations. Sometimes, the same system can described using 
these two different ways. However, there is no universal relationship between a rule-based 
system and an equation-based system [22]. Given differential equation, it is possible to 
construct a rule-based cellular automaton by discretizing the differential equations, but it 
is far more complicated to formulate a system of partial differential equations for a given 
cellular automaton. For example, the following 2-D partial differential equation for nonlinear 
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Figure 4: a) Initial random configuration on a 500 x 500 grid at t = 0; b) 2-D Pattern 
formation and distribution displayed at t = 100. 



pattern formation for u{x,y,t) 

can always be written as an equivalent cellular automaton if the local rules of cellular 
automaton are obtained from the PDE. Conversely, a local cellular automaton can lead to 
a local system of partial differential equation (PDE) , if the construction is possible [22] . A 
local PDE can generally be written as 

F{u,Ux,Uy,...,x,y,t) (9) 

A nonlocal PDE can be written as 



J^{u,Ux,Uy, ...,x,y,t,x + S{x,y,p),y + S{x,y,p)) = 0, (10) 

where S{x, y,p) is the the averaged distance of long-range shortcuts and p is the probability 
of nonlocal long-range shortcuts. In order to show what a nonlocal equation means, we 
modify the above equation for pattern formation as 

ut = DV^u{x,y,S,p,t) +-fu{x,y,S,p,t)[l - u{x,y, S,p,t)]. (11) 

This nonlocal equation is far more complicated than equation (8). For the proposed cellular 
automaton networks, a system of nonlocal partial differential equations will be derived, 
though the explicit form of a generic form is very difficult to obtain and this requires 
further research. 



4.4 Pattern Formation 

Even for simple nonlinear partial differential equations, complex pattern formation can 
arise naturally from initially random states. For example, the following nonlinear partial 
differential equation for pattern formation u{x, y, t) 
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(a) (b) (c) 

Figure 5: a) The UC2007 logo has been mapped onto a 200 x 200 grid as the initial condition 
at t = 0; b) 2-D pattern distribution with a short-cut probability p = 0.0025 and 5 = 5 (or 
/3 = 0.05) displayed at t = 200; c) 2-D pattern with a short-cut probability p = 0.01 and 
5 = 50 (or /3 = 0.2) at t = 200. 

can be discretized using central finite difference scheme in space with Ax = Ay = At = 1. 
Then, it is equivalent to 

<V= E «-fcX+fc,i+; + 7<,-(l-<,-)+/3<-5,„ (13) 

k,l=—r 

where r = 1, ao,o = 1 — 4Z),a_i^o = cl+i,o = oo,-i = oo,+i = D. It is a cellular automaton 
with the standard Neumann neighbourhood for this PDE. 

The formed patterns and their distribution resulting from the system on a 500 x 500 
grid are shown in Fig. 4 where D = 0.2, 5 = 5, 7 = 0.5 and (3 = 0.01. We can see that 
stable patterns can be formed from initial random states. 

The formed patterns using the Neumann neighbourhood (r = 1) are very stable and are 
almost independent of the initial conditions. In fact, the initial state does not matter and 
the only requirement for the initial state is some degree of randomness. If we run the same 
program using a photograph or the UC2007 conference logo, similar patterns can also form 
naturally as shown in Figure 5. In our simulations, we have used D = 0.2 and 7 = 0.5. 
Other parameters S and /3 can vary. For the case shown in Fig. 5b, S = 5 and /? = 0.05, 
while S = 50 and /3 = 0.2 are used in Fig. 5c. This means that the initial state does 
not affect the characteristics of pattern formation and this is consistent with the stability 
analysis [22j. 

5 Discussions 

Small-world cellular automata networks have been formulated to simulate the interactions 
and behaviour of multi-agent systems and small-world complex networks with long-range 
shortcuts. Simulations show that power-law distribution emerges for a fixed probability of 
long-range shortcuts, which implies self-organized criticality in the avalanche and evolving 
complex patterns. For a given size of cellular grid, the increase of the probability of long- 
range shortcuts leads to a transition, and in this case, a single even can affect a large fraction 
of the whole population. In this sense, the characteristics of small-world cellular automota 
are very different from the conventional locally interacting cellular automata. 

The nonlocal rule-based network systems in terms of cellular automata can have other 
complicated features such as its classifications compared with the conventional automata 
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and its relationship its partial differential equations. In addition, cellular automota net- 
works could provide a new avenue for efficient unconventional computing for simulating 
complex systems with many open questions such as the relationship between cellular au- 
tomata networks and nonlocal PDEs, and the potential implication on the parallelism of 
these algorithms. These are open problems to be investigated in the future research. 
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